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Abstract 

Differential evolution was developed for reliable and versatile function optimization. It has 
also become interesting for other domains because of its ease to use. In this paper, we posed 
the question of whether differential evolution can also be used by solving of the combinatorial 
optimization problems, and in particular, for the graph coloring problem. Therefore, a hybrid self- 
adaptive differential evolution algorithm for graph coloring was proposed that is comparable with 
the best heuristics for graph coloring today, i.e. Tabucol of Hertz and de Werra and the hybrid 
evolutionary algorithm of Galinier and Hao. We have focused on the graph 3-coloring. Therefore, 
the evolutionary algorithm with method SAW of Eiben et al., which achieved excellent results for 
this kind of graphs, was also incorporated into this study. The extensive experiments show that 
the differential evolution could become a competitive tool for the solving of graph coloring problem 
in the future. 
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I. INTRODUCTION 



The graph coloring problem (GCP) can be informally defined as: How to color the graph 
G with the fc-colors so that none of the vertices connected with an edge is colored with 
the same color. The minimum number of colors k needed to color the graph G is called 
the chromatic number x [22j- The graph is /c-colorable if it has a fc-coloring, i.e. it can 
be colored with k colors. The problem of finding the correct 3-colorability of the graph 
G is iVP-complete [16J, while the problem of finding the chromatic number of graph G is 
iVP-hard [3]. 

To date, many approaches have been proposed to solve the GCP [T5J |2J]. The most 
natural approach to coloring the vertices of graph is in a greedy fashion [3j. Here, the vertices 
are ordered into a permutation and colored sequentially. Although the greedy algorithm, in 
general, does not find an optimal number of colors, Grimmet and McDiarmid [19] showed 
that this number is no more than about twice the chromatic number. In fact, the quality 
of greedy coloring depends on the permutation of the vertices. To improve the coloring, 
Brelaz [I] proposed the algorithm DSatur, which utilizes a dynamic ordering of vertices. 
This ordering depends on the number of distinctly colored vertices adjacent to the vertex v, 
i.e. the saturation degree p(v). 

While exact algorithms can solve instances up to 100 vertices, heuristic methods are devel- 
oped for larger instances [T5] . These can be divided into local search methods [TJ and hybrid 
algorithms, which combine the local search methods with evolutionary algorithms [23]. One 
of the first local search heuristics for the GCP was Tabucol [21] , which uses the tabu search 
algorithm proposed by Glover [17J. This heuristic approach was later improved by Fleurent 
and Ferland [13] and Galinier and Hao [13] ■ The hybrid evolutionary algorithm (HEA) of 
the later authors is still the best algorithm for GCP today, where the Tabucol that acts as 
a local search heuristic is guided by the evolutionary meta-heuristic. 

The differential evolution (DE) is a population based, very effective global optimization 
algorithm that was proposed by Price and Storn |30j in 1995. In many ways, DE |27J is a 
typical evolutionary algorithm with differential mutation, crossover and selection. Usually, 
DE was applied to continuous function optimization problems. On the other hand, many 
attempts to solve the combinatorial optimization problems with DE have been tackled in 
recent years. Pan et al. in [2_B] proposed the discrete differential evolution (DDE) algo- 
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rithm for the permutation flow scheduling problem. The DDE, hybridized with a variable 
neighborhood search [23], was applied to the generalized assignment problem (GAP) by 
Tasgetiren et al. in 2009 (32]- Recently, Tasgetiren et al. in 2010 [33] proposed an ensemble 
of DDE, where each individual is assigned to one of the three distinct DE strategies. A 
comprehensive survey of the main methods in DE can be found in [10] . 

In this paper, we try to answer the question of whether the DE could be used to solve 
the GCP. We are focused on graph 3-coloring (3-GCP), which is a special kind of A;-GCP, 
where k = 3. Moreover, the 3-GCP can be defined as a constraint optimization problem 
where the real-valued weights assigned to each vertex establish how difficult the particular 
vertex is to color. The values of the weights determine the order in which the vertices need 
to be colored. In other words, these defines the permutation of vertices that determines the 
sequence in which the constraints should be resolved. In line with this, we translate the 
definition of 3-GCP to real-valued parameter optimization. 

Obviously, the proposed DE is used as a generator of new solutions in the continuous 
search space, whereas a traditional DSatur algorithm was used for the decoding of vertex 
permutation to a coloring. This approach is not new, because it was already used by Eiben 
et al. [11]. Despite DSatur, the greedy algorithm was employed as a decoder. Furthermore, 
the self-adaptation of the parameters F and CR, which controls a differential mutation and 
crossover, was applied. These parameters are changed using the uncorrelated mutation as 
proposed by Eiben and Smith [12J, which has shown good results by solving of particular 
combinatorial optimization problems p£T]. Finally, this algorithm was hybridized with a 
local search heuristic and, therefore, in this paper, it is denoted as HSA-DE. The local 
search heuristic is novel and represents a kind of swap heuristic [12] . Extensive experiments 
were conducted on a collection of random 3-colorable graphs generated by the Culbersone 
graph generator [9] . Note that the selected test suite was the same as by Eiben et al. in [11] . 
Unfortunately, the Dimacs Benchmark suite that consists of the graph coloring problems 
does not contain any 3-colorable graph. 

The structure of the rest of paper is as follows: In Section 2, the 3-GCP is discussed 
in details. The HSA-DE is described in Section 3, while the experiments and results are 
presented in Section 4. Through experiments, the phase transition phenomenon is exposed, 
which refers to the "easy-hard-easy" transition regions, where the problem goes from the 
status "easy-to-solve" to "hard-to-solve" and conversely [34]. The paper is concluded with 
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a discussion about the quality of results and directions for the further work. 



II. GRAPH 3-COLORING 

Graph 3-coloring of an undirect graph G = (V, E), where V denotes a finite set of vertices 
and E a finite set of unordered pairs of vertices (t> j, v j) named edges for i = 1 . . . n A j = 
l...n, is a mapping C : V — > C, where C = {1,2,3} denotes a set of 3-colors, i.e. the 
assignment of 3-colors to the vertices of G. The proper 3-coloring is obtained when no two 
adjacent vertices are assigned to the same color [3]. 

3-GCP can be formally defined as a constraint satisfaction problem (CSP) that is rep- 
resented as the pair (S,4>), where S denotes the free optimization problem (FOP) and (j) 
a Boolean function on 5* (also feasibility condition). For graph 3-coloring the candidate 
solution x G S is represented as a permutation of vertices, while the feasibility condition 
is expressed as a conjunction of all constraints 0(x) = A„ ie yC Ui (x), where C Vi is defined as 
the set of constraints including the vertex Vi. 

Typically, constraints are handled in DE indirectly in the sense of the penalty function 
that transforms the CSP into FOP [12]. That is, the infeasible solutions that are far away 
from a feasible region are specified by higher penalties. The penalty function that is used 
also as objective function here, is expressed as: 

n 

/(*) = 5>(*,cn (1) 

where the function if)(x,C Vi ) is defined as: 

{1 if a; violates at least one c,- e C v \ 
(2) 
otherwise. 

In fact, Q can be used as a feasibility condition in the sense that <p(x) = true if and 
only if f(x) = 0. Note that this equation evaluates the number of constraint violations and 
determines the quality of solution x G S in a permutation search space that is huge, namely 
\S\ = nl 
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III. HYBRID SELF-ADAPTIVE DIFFERENTIAL EVOLUTION FOR GRAPH 3- 
COLORING 

The DE is simple, powerful, population-based direct search algorithm for the globally 
optimization of functions [30]. Like other population-based methods, the DE starts with 
the population of randomly generated initial points in search space. Candidate solutions 
are modified with the scaled difference of two randomly selected solutions. A trial solution 
is generated by adding of this difference to a third, randomly selected solution. This trial 
solution competes with the corresponding solution for survivor. In fact, the solution with 
the lower value of objective function survives and can evolve in the next generation. 

The candidate solution of the DE for 3-GCP is represented as a real-valued vector = 
{wfj} for i — 1 . . . NP Aj = 1 . . . nAt — 1... FEs max , where NP denotes the population size, 
n the number of vector components and FEs max the maximal number of objective function 
evaluations. The vector components Wj G [6^, b^u\ representing weights are limited by 
n-dimensional vectors hi and bjj that indicate the lower and upper bounds, respectively. 
Note that the weights determine how hard a corresponding vertex is to color and, thus, 
define the order in which the vertices will be colored. Each weight is initialized as follows 
(DE/rand/l/bin): 

w!$ = rand(0, 1)- (b jtU - b j}L ) + b jtL , for j = 1 . . .n. (3) 

The DE supports a differential mutation, a differential crossover and a differential se- 
lection. In particular, the differential mutation randomly selects two solutions and adds a 
scaled difference between these to the third solution. This mutation can be expressed as 
follows: 

uf = w% + F- (wjf - 4? ) , for i = 1 ... NP, (4) 

where F e [0.1, 1.0] denotes the scaling factor as a positive real number that scales the rate 
of modification while rO, rl, r2 are randomly selected vectors in the interval 1 . . . NP. 

Uniform crossover is employed as a differential crossover by the DE. The trial vector is 
built out of parameter values that have been copied from two different solutions. Mathe- 
matically, this crossover can be expressed as follows: 
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ufj randj(0, 1) < CRV 3 = j r 



and: 



*i,3 = { ' ' ' (5) 

}\ • otherwise, 

where CR G [0.0, 1.0] controls the fraction of parameters that are copied to the trial solution. 
Note, the relation j = j ran d assures that the trial vector is different from the original solution 
y(t). 

Mathematically, differential selection can be expressed as follows: 



~ < ' ^ (6) 



z, 



{t) if f(z®) < /(y. (t) 



W; otherwise . 



Note that the trial vector replaces the target vector when the objective function 
value of the trial vector f(Z^) is equal or lower than the objective function value of the 
target vector f(Y^). The objective function is calculated according to (11). 



A. Self-adaptation 

In general, the behavior of the DE depends on the control parameters F and CR. How- 
ever, setting these parameters depends on a problem that is solved by the DE. On the 
other hand, the initial setting of these parameters can become poor in matured generations. 
Therefore, the self-adaptation of the control parameters [21 E] is introduced into the DE for 
3-GCP. 

The self-adaptive DE for 3-GCP represents an extension of the classical DE algorithm. 
Thus, a representation of the solution is expanded by four bytes, i.e. the solution is now 
represented as a tuple Y^ = (wfl, . . . ,wf1, F^\ a®, CRf\ uf{)- The additional elements 
represent: the control parameter with the corresponding mutation strength <j\ q and the 
control parameter CR^' with its mutation strength af\. Furthermore, the parameter F^ is 
mutated according to ([7]) [T2] : 



a 



(*+i) 

i,0 



a§-exp(T-N(0,l)+T-Ni(p,l)), 
^ (t+1) = ^ ) + 4 +1) -iV l (0 ) l)) ) 



(7) 
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while the parameter CR^ is mutated according to (|8l): 



= ex P( T '- N (°> !) + T ' N *(°> !))' (g) 
Ci?f +1) = Ci?f + af 1 +1) - iV f (0, 1)). 



The parameters r oc \j\J1- n and r oc l/y 2- v/n) denote the learning rates. To keep 



the mutation strengths crfj 1-1 ^ and crfi greater than zero, the following equations are used: 



°"i,o < e o =>• o"i, = eo and 

The parameters afl and cr}i determines a region in which an evolutionary search can 
progress and, therefore, a correct setting of their starting values crfl and af{ have the 
significant influence on the performance of this algorithm. 



B. Genotype-Phenotype Mapping 

Conventional DE algorithms explore continuous search space (also known as genotype 
space). However, 3-GCP is a combinatorial problem and has a discrete problem space (also 
known as phenotype space). In contrast to many graph coloring algorithms that encode 
solutions as binary strings [18J, the proposed self-adaptive DE algorithm employs a special 
genotype-phenotype mapping. This acts as follows: A solution of the 3-GCP is defined 
within the self-adaptive DE algorithm as a tuple = (wfl, . . . , w^ n , a\ q, CB,f\afl) 
for i = 1 . . . NP. That is, the solution is described by this DE algorithm indirectly. All 
candidate solutions thereby define the genotype search space. On the other hand, a quality 
of these solutions is evaluated in the phenotype problem space. 

The genotype-phenotype mapping consists of two phases: 

• transformation of weights in permutation of vertices, 

• decoding of solution by DSatur construction heuristic, 
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In the first phase, only weights are taken from the solution ly . Then, these are put in 
descending order and, according to their ordering, a permutation of vertices Xf' = {vfj} 
for j = 1 ... 77, is constructed. From this permutation, the DSatur construction heuristic 
decodes a coloring = {cfj} for i = 1 . . . NP Aj = 1 . . . n, where q*j G {1, 2, 3} represents 
the solution in a phenotype space. Note that the phenotype space is much smaller than the 
genotype space, namely \C\ = 3™. 

After decoding, the quality of the solution is evaluated by the counting the number of 
constraint violations according to Q. 

C. Hybridization with Local Search 

The current solution of the self-adaptive DE can be improved with a local search heuristic. 
The local search heuristic tries to improve the current solution with small adjustments to 
weights until improvements are perceived. The proposed algorithm was hybridized by the 
ordering by saturation heuristic. In line with hybridization, the proposed algorithm was 
named: the hybrid self-adaptive differential evolution algorithm (HSA-DE). 




FIG. 1: Order local search heuristic. 



The proposed heuristic acts as follows: Initially, it locates the first uncolored vertex. 
Then, a set of neighbors to this vertex is determined. The set that represents a neighborhood 
are put in descending ordered with regard to the values of saturation degrees. In the end, the 
neighbor with the highest value of saturation degree is swapped with the uncolored vertex. 
Actually, the neighborhood is defined by a set of possible l-swap strokes. 

The way, in which this heuristic operates is illustrated in Fig. [TJ where v denotes the 
permutation of weights, c the corresponding coloring, w the weights and d the saturation 
degrees. Here, the first uncolored vertex 4 is shadowed, while its adjacent vertices 1, 6 and 
7 are hatched. Because the vertices 1 and 7 have the same saturation degree, the vertex 7 
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is selected randomly. Finally, the vertices 4 in 7 are swapped (right-hand side of Fig. [L 



IV. EXPERIMENTS AND RESULTS 

The goal of an experimental work was to show that the HSA-DE can be used to solve 
the 3-GCP. Therefore, a comparison with algorithms: 

• Tabucol [21], 

• the hybrid evolutionary algorithm (HEA) [H], 

• the evolutionary algorithm with the method SAW (EA-SAW) [Tiij and 

• the hybrid self-adaptive differential evolution algorithm (HSA-DE), 

was accomplished. The first two algorithms are some of the best known algorithms for the 
fc-GCP today. Furthermore, the implementation of both are published on internet sites (8] 
as help to developers of new graph coloring algorithms. Interestingly, the implementation 
of EA-SAW can be found online |35j as well. However, the later algorithm was designed 
especially for the 3-GCP. In our opinion, the paper of Eiben et al. [TT], in which it was 
described, is one of the most complete publications about 3-GCP today. Thus, this paper 
was taken SIS db reference for comparison. 

The characteristics of the proposed HSA-DE, as used in the experiments, are as follows. A 
population size was set to 15 because this value represents a good selection as was indicated 
during the experimental work. In general, the strategy DE/rand/l/bin was employed. The 
local search heuristic was applied with the probability pi s = 0.02. As previously mentioned, 
the most attention was given to setting the correct starting values of mutation strengths 
erjo and er|° . After preliminary experimentation, the values (Xq ^ = 30.0 and = 30.0 
were selected. The number of objective function evaluations FEs max = 300, 000 was used as 
the termination condition. Because of the stochastic nature of the mentioned algorithms, 
multiple runs were observed, and the number of runs was limited to 25. 

Algorithms were compared according to the measures: 

• success rate (SR) and 

• average number of objective function evaluations to solution (AES), 
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where the first measure expresses the ratio of the number of successful runs among all runs 
and the second reflects the efficiency of the particular algorithm. 

A. Test Problems 

A test suite consisted of random graphs generated by Culbersone graph generator [H]. 
The generated graphs are denoted as G t;n>P)S , where t represents the type of graphs, n the 
number of vertices, p the probability that two verices Vi and Vj are connected with an edge 
(vi,Vi) and s the seed of the random graph generator. Indirectly, the parameter p controls 
the edge density. Among the many types of graphs equi-partite, uniform and flat graphs 
were generated because of the comparison with the selected reference [11]. In equi-partite 
graphs, the vertices are split into 3-color sets and then edges are selected so that the sizes of 
all 3-color sets are as nearly as possible. In uniform graphs, the vertices are assigned to one 
of the 3-color sets uniformly and independently, according to the predefined probability [7] . 
The flat graphs are similar to the equi-partite, with an additional property that variations 
of expected vertex degrees are minimized. All graphs were generated with the number of 
vertices set at n — 1,000. These kind of graphs were also referred to as large-scale in [TT] . 
The seed s of the random graph generator does not have a notable impact on the results, as 
noted by Eiben et al. [TT]. To keep the comparison fairly, the s = 5 was used. 

The most combinatorial optimization problems are sensitive on the phase transition phe- 
nomenon that determines the regions, where the problem passes from the state of "solvable" 
to the state of "unsolvable" and vice versa [34]. Typically, these regions are connected 
with some parameter addressing the problem. For the 3-GCP, this parameter is the edge 
probability p. Many authors identified different critical values of this parameter, which de- 
termines the phase transition region. For example, Petford and Welsh [2H] stated that this 
phenomenon occurs when 2pn/3 ~ 16/3, Cheeseman et al. [6] when 2m/n 5.4, Eiben et 
al. [UJ when 7/n < p < 8/n and Hayes [20] when m/n « 2.35. Note that the parameter m 
in the above-mentioned formulas denotes the number of edges. In this paper, however, we 
consider that the hard problems occur when p = 0.007. 
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B. Influence of the Edge Density 



In this test, the phenomenon of phase transition was investigated. Therefore, random 
graphs were generated in which edge probabilities varied from p = 0.004 to p = 0.014 in 
steps of 0.001. As a result, 11 instances of randomly generated graphs were obtained for 
each type of the observed graphs. 

The results of the comparison are illustrated in Fig. |2j This figure is divided into six 
graphs, according to the type and measures SR and AES. The graphs capture the results of 
all 11 instances that were obtained by varying the edge probability p. 

As can be seen in Fig. [2}a, the HEA is certainly the best algorithm for GCP, based on 
the measure SR. Although it has some difficulties solving graphs with the edge probability 
p = 0.007, where the SR=0.08 was reached and the p = 0.008, where the SR=0.56 was 
reached, other graph instances were solved excellently (SR=1). Interestingly, the HSA-DE 
also solved all graph instances but results by 3-coloring outside of the phase transition region 
were worse than with Tabucol and better than with EA-SAW. Tabucol and EA-SAW did 
not solve the graph with p = 0.007. Moreover, Tabucol also did not solve the graph with 
p = 0.013 in all runs that needed to be outside of the phase transition region. This problem 
is connected with the fact that here the second phase transition exists [26] as well. The 
results, according to the measure AES in Fig. [2jb, show that the HSA-DE, more or less, 
follows the results of the HEA. Interestingly, results far away from the phase transition 
region are even better than with the other observed algorithms. 

As illustrated by Fig. |2jc, the results of the HSA-DE on uniform graphs are comparable 
with the results of the EA-SAW, but worse than results of the HEA and Tabucol. Similar 
to the equi-partite graphs, Tabucol was sensitive in the second phase transition region. 
According to the AES (Fig. |2jd) the results of the HSA-DE were worse than the results of 
all other observed algorithms in the vicinity of the phase transition region, but overcame 
the results of the other algorithms in the region outside of it. 

Finally, the HSA-DE come nearer to the results of the EA-SAW, according to the SR, by 
3-coloring of flat graphs (Fig. |2je) . However, the results of both algorithms were worse than 
the results of the algorithms for fc-GCP. As can be seen in the Fig. [2}e, these types of graphs 
are the hardest for all of the observed algorithms. Moreover, both algorithms for /c-GCP are 
sensitive to the second phase transition as well. According to the AES (Fig. [2]), the HSA-DE 
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FIG. 2: Results of algorithms for 3-GCP solving equi-partite, uniform and flat random graphs 



improved the results of the EA-SAW before and after the phase transition region. 



C. Influence of the Local Search Heuristic 

A goal of this experiment was to investigate the influence of the local search heuristic 
on results of the HSA-DE. In this sense, the self-adaptive DE without a local search was 
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FIG. 3: Two independent runs of the HSA-DE 

compared with the original HSA-DE. Because we focused on the behavior of the HSA-DE 
in the phase transition region, the edge density of graphs were varied from p = 0.006 to 
p = 0.009 with steps of 0.001. Note that the equi-partite graphs were investigated only. The 
results of the experiment are presented in Table |T} 

TABLE I: Influence of the local search by HSA-DE on equi-partite graphs. 



P 



HSA-DE NONE 
SR AES 



HSA-DE LS 
SR AES 



0.006 1 
0.007 
0.008 0.12 
0.009 0.44 



52.76 1 

0.04 

267,364 0.2 

170,447 0.72 



70.92 
189,087 
138,542 
167,178 



avg 



0.39 



184,465.94 0.49 



123,719.48 



From Table [T] it can be seen that hybridization with a local search was successful when the 
probability pi s = 0.02 was used, but increasing of this parameter can lead to worse results, 
as indicated by experiments. 

D. Discussion 

To discover how the HSA-DE explores a search space a deeper analysis of how it acts 
needs to be performed. Therefore, two independent runs of the HSA-DE were examined 
by solving the equi-partite graphs with p = 0.008, where the solution is either found as 
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illustrated in Fig. [3}a or not found as in Fig. [3jb. In these figures, the average number of 
uncolored vertices in the population and the current minimum number of uncolored vertices 
are recorded throughout the runs. 

In Fig.[3]a, it can be seen that the curve, which denotes the minimum number of uncolored 
vertices, converges to the optimal value very fast at beginning. Then, the decline is slower. 
When the solution is not found (Fig. |3}b) the current minimum number of uncolored vertices 
falls from 80 to 50 very rapidly, but when the evolutionary search progresses, no further 
improvements are detected. That is: the HSA-DE sinks into the local optima. If we look at 
the average number of uncolored vertices in the population, we can observe that this value 
is very close to the best number of uncolored vertices. Because this value can be taken as a 
measure of population diversity p2] we can conclude that the population looses its diversity 
very quickly. As noted by Back in [2] , the diversity of the population is a prerequisite for the 
self-adaptation. Therefore, it needs to be increased. Obviously, diversity can be increased 
in many ways. For example, it can be done by increasing of the population size NP, or 
conducting a new vectors in the population during the evolutionary process, etc. Although 
the diversity of the population was increased by applying either of the proposed mechanisms, 
at this moment, neither of these bring any visible improvement to the results. Therefore, to 
find the mechanism that would be able to balance an exploration (population diversity) and 
an exploitation (selection pressure) [12] in DE remains the great challenge for future work. 

V. CONCLUSION 

In summary, the gained results show that the HSA-DE for 3-GCP is better than the EA- 
SAW by solving of equi-partite graphs and it is comparable by solving of other three graph 
types. However, both of the mentioned algorithms achieved worse results than algorithms 
for fc-GCP, i.e. HEA and Tabucol, by solving of all other three types of observed graphs. 
Obviously, our intention in this paper was not to improve the results of these algorithms 
but to show that DE can be applied to the GCP. In this first step, the HSA-DE obtained 
results that are comparable with EA-SAW. However, in order to develop an algorithm that 
would be comparable with the best algorithms for fc-GCP, more investigations would need 
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to be conducted. 
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